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matical journals. The reading of the same things goes far toward creating points 
of contact and developing common interests, and it is these common interests 
between high school and university instructors which will tend to remove the 
objectionable features of the gap with which the freshman has to contend. When 
an evil in the physical world begins to assume serious proportions, its antidotes 
become prominent objects of study. One of the strongest antidotes against the 
forces which tend to produce harmful gaps in our mathematical education may 
be found in the uniting tendencies of the mathematical journals. As these 
journals constitute such a strong directing and inspiring force and provide a 
forum where all may meet at will for the discussion of problems, they should 

be heartily supported by all teachers of mathematics. 

In closing I desire to lay great stress on another point, namely the history of 
the subjects we teach. The normal student is most deeply interested in some 
historical facts but most of us are too lazy or too indifferent to study the history 
of our subject sufficiently to speak about it in simple and accurate language. A 
few historical observations now and then put new life into our classes. It is all 
the more necessary that we cultivate a continuous acquaintance with the history 
of our subjects since the recent progress of our knowledge along this line has been 
so rapid. In history we find a bond which unites not only all those interested in 
mathematics but also all who are interested in the development of the intellect. 



ON THE SOLUTIONS OF LINEAR EQUATIONS HAVING SMALL 

DETERMINANTS. 

By F. R. MOULTON, University of Chicago. 

The fundamental theorem respecting linear non-homogenous equations is 
that their solution exists and is unique if the determinant of the coefficients of 
the undetermined quantities is distinct from zero. But this simple theorem 
does not by any means contain all that is important from a practical point of 
view. If the coefficients of the equations are furnished by observations, or by 
measurements, they are determined only to a certain number of places. The 
question then arises how exact their solution is. In the discussion of this question 
the magnitude of the determinant plays an important role, and the results are 
particularly interesting and striking when the determinant is small. 

For the sake of illustration of some of the peculiarities of the solutions of 
linear systems, before taking up the general discussion, consider the equations 



(1) 



34622 x + .35381 y + .36518 z = .24561, 
89318 x + .90274 y + .91143 z = .62433, 
I .22431 x + .23642 y + .24375 z = .17145. 
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It will be supposed that the coefficients and right members of these equations are 
furnished by observations, and that the possible errors to which they are subject 
do not exceed five units in the sixth place. The problem is to determine x, y, 
and z and to find the degree of accuracy of the determination. 

A system of linear equations turns up in many problems of applied mathe- 
matics. Indeed, it was such systems in the theory of the determination of the 
orbits of the heavenly bodies from observations from the earth which led to the 
considerations which are developed here. They arise in all problems involving 
the determination of quantities by the method of least squares. In these com- 
putations it is of course essential that the work be done with numerical precision, 
and this has led to systematic modes of procedure and the development of control 
formulas for use in the process. The method, aside from the control formulas, 
for solving linear systems is to eliminate one unknown from all of the equations 
except one by use of the one. Then, one equation of the reduced set is used to 
eliminate a second unknown. The process is repeated until a single equation 
remains involving a single unknown. 

In applying the process for solving linear equations, which has been described, 
to equations (1) no difficulty is encountered. It is true that a zero turns up at the 
successive stages in the first place on the left, but it is natural to multiply such 
equations by 10, or to add another figure on the right. It is found on carrying out 
the solution with seven-place tables that 

(2) x = - 1.027066, y = + 2.091962, z = - 0.380515. 

On substituting the values of x, y, and z in (1) it is found that these equations are 
satisfied to the last place. Moreover, if either x, y, or z alone is changed by so 
much as one unit in the fifth place the equations will no longer be satisfied. But 

f x = - 1.022773, y = + 2.084125, z = - 0.376941, 

(3) \ 

L x = - 1.031229, y = + 2.099457, z = - 0.383879, 

also satisfy equations (1) up to the last place. The variation in x is nearly one 
per cent., and in z nearly two per cent. That is, although equations (1) are sup- 
posed to be accurate to five places, their solution is determinate only to two 
places; or, expressed otherwise, the uncertainty in the result is a thousand 
times what might be expected. 

The phenomenon exhibited by (1), (2), and (3) is to be explained. If equa- 
tions (1) are written in the form 

aix + biy + ciz = d u 

(4) ■{ a 2 x + b 2 y + c 2 z = d 2 , 



the expression for x is 



. a 3 x + bzy + c z z = d 3 , 
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(5) 



X = 



di, b x , d 




di, 6 2 , c 2 




^3, b z , c 3 


Z>* 


ffli, b u a 


" Z) 


«2, b 2 , c 2 




«3, 63, c 3 





There are similar expressions for y and z. 

Suppose the numerical value of D is small. If a„ 6„ and c, are defined only to 
five places and the first three places in D are zeros, D is in reality given only to 
two places. Consequently x is defined only to two places. In the numerical 
example D is small, and this is the explanation of the variations in the solutions. 
The value of D is 

.34622, .35281 .36518 



D = 



.89318, .90274 .91143 
.22431, .23642 .24375 



Let the second column be subtracted from the first and third columns, and let 
the resulting third column be added to the first. These operations do not change 
the value of the determinant which then takes the form 



D 



+ .00378 .35381 .01137 

- .00087 .90274 .00869 

- .00478 .23642 .00733 



which is necessarily small because the elements of both the first and the third 
columns are small. 

Suppose the coefficients a„ bi, Ci, and di are given by observations to a certain 
number of places, and consider the problem of finding the greatest variations 
possible in x, y, and z. Suppose the determinant D is not zero, though it may be 
small; then equations (4), regarding the a», 6», c», and d { as being exact, have a 
unique solution. The assumption that the coefficients are exact is equivalent to 
saying that all the digits beyond the number of places given are zero (assuming 
that all numbers are given in the decimal form). Let x, y, and z represent the 
solution of (4). In order to use effectively the hypothesis that the digits beyond 
those given are zero it will be necessary to use more places in the computations 
than are given in the coefficients. This was done in computing (2), and when 
these values of x, y, and z are substituted in (1) the digits in the sixth places are 
zeros. 

Suppose the exact values of the coefficients are 
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(6) 



a, + oii , hi + ft , a + ji , di + Si (i = 1, 2, 3), 



where a„ hi, c,-, and di are the numbers furnished by the observations, and where 
<Xi, ft> ji, and S,- are the differences between these numbers and the true values of 
the quantities measured. The latter quantities are, of course, not known, but 
generally limits can be placed on their possible magnitudes. For example, it 
might be that they would not exceed five units in the first neglected place. The 
problem is to find the greatest admissible variations in x, y, and z for all admissible 
variations in the a,-, ft, ji, and 5;. For any set of a,-, ft, y,-, and Si suppose the 
corresponding values of the unknown quantities are 



(7) 



« + £, y + v, * + f • 



It is supposed that the determinant is not zero with the coefficients (6). 
With the notation that has been adopted the equations become 

" (ai + ai )(x +0+ (6i + Pi)(3f +V)+ (ci + 7i)(« +0 = d 1 + S u 

(8) - (a, + a 2 )(x +0+ {h + h)<y +r,)+ (c + T«)(« + f) = ^2 + 5 2 , 

. (a, + a 3 )(x + £) + (b 3 + ft)Q/ + V )+ (fi, + y,)(z +{) = d s + 8 3 . 
After subtracting equations (4) the equations defining £, 77, and f are 

" (ai + «i)| + (61 + 181)77 + (ci + 7i)f = Si - ana: - ft?/ - Jiz, 

(9) - (o 2 + a 2 )% + (b 2 + /3 2 )»7 + ("2 + 72) f = §2 — a2X — ft?/ — 722, 

. (as + «3)£ + (63 + 183)57 + ( c 3 + 7s)? = h — a 3 x — ft?/ 
The expression for | is 

61 — aiz — ft?/ — 71Z, 61 + ft, ci + 71 

5 2 — 0:2a; — ft?/ — 72Z, &2 + 182, c 2 + 72 

5 3 — a s x — fay — 73Z, h + 183, c 3 + 73 



732. 



(10) 



$ = 



ai + ai, &i + 181, ci + 71 

a 2 + a 2 , h 2 + ft, c 2 + 72 

«3 + «3, &3 + 183, c 3 + 73 

The problem is to find the greatest numerical value of £ for admissible values of 
the a;, ft, 7;, and Si. 

The denominator determinant must have the same sign for all admissible 
values of the a i} ft, and 7* in order that the original problem shall be at all 
determinate, for otherwise £ is not bounded either in the negative or the positive 
direction. Suppose the at, ft, and y, are so small that terms of the second degree 
in these quantities are relatively insensible; then the denominator of (10) becomes 
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(11) 



D t = 



ffli, hi, ci 




#2, hi, C2 


+ 


a s , b$, d 





oci, h u d 


j 


a 2 , hi, ci 


+ 


ct-z, h%, c 3 





ai, jSi, ci 




a>2, ft, c 2 


+ 


«3, ft, c 3 





«i, 


hi, 7i 


«2, 


&2, 72 


as, 


hz, 73 



The first of these determinants, which is D of equation (5), is small in case of the 
equations which arise in the determination of orbits because the three columns are 
approximately equal. The numerical example with which this discussion was 
started illustrates the matter. When this condition is not satisfied initially it 
can be brought about, in case D is small, by linear combinations of the rows of 
the determinant. Hence it will be supposed that this condition is satisfied, and 
further that the elements of the second column are greater than those of the first, 
and that those of the third column are greater than those of the second. 
The expansion of the second determinant of (11) is 

ociihcs — 6 3 c 2 ) — 0:2(6103 — 63C1) + diihiCi — h 2 ci). 

Let the numerically largest of the three parentheses be represented d%. Then the 
second determinant of (11) can not exceed 35d 2 in numerical value, where 8 is 
the greatest numerical value the an can take. There are corresponding results 
for the third and fourth determinants of (11). Let d be the value of the numer- 
ically greatest of d%, d z , and d±. Then the sum of the last three determinants of 
(11) can not exceed in numerical value 96d. The value of § is five units in the 
first neglected place. Consequently 98 is about five units in the last place. But 
because of the approximate equality of the columns of the determinant d is also 
a small quantity. In the given numerical example, which is comparable to what 
often arises in practice, d is less than .02. In this example 9dd is less than one 
unit in the sixth place, while D, the first determinant of (11), is more than fifty 
times as great. In all such cases where D has one or more significant figures 
which are distinct from zero, the first significant figure of § is independent of the 
«,-, (3,:, and 7; so far as they appear in the denominator of (10). When this condi- 
tion is not satisfied the problem is practically indeterminate and further discussion 
is useless. When this condition is satisfied the difference of the second and third 
columns of the numerator of (10) will have at least one significant figure which is 
distinct from zero, and consequently in these columns the ft and 7; can be 
neglected. Therefore when D has one or more significant figures distinct from 
zero, at least the first significant figure of £ is determined by 



(12) 



Dl- 



Si — otix — (3iy — 712, 

8 2 — aix — fty — 722, 

83 — a s x — p 3 y — 732, 



61, 

hi, 



Cl 



c 2 



C.3 



The numerical value of £ is greatest when the a,-, ft, y it and 8; have such signs that 
all the terms of the expansion of (12) have the same sign and their largest possible 
numerical values. Suppose the a,-, ft, y t , and 8; all have the same greatest 
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possible numerical value 5. Let \x\, \ b 2 c 3 — b 3 c 2 |, • • • represent the numerical 
values of x, b 2 c 3 — c 3 c 2 , • • • ; then the greatest numerical value of f is 

(13) £ = jjjj {l+|*|+|y| + |z|}{| hcz — b a c 2 | 

+ | hd — bic 3 | + [ hd — b 2 c x | } t 

which is positive or negative according as 5 is taken positive or negative. 

There are expressions corresponding to (13) which give limits on the numerical 
values of -q and f . They differ from (13) only in that b t is replaced by a; and c; 
by aj respectively. Since the signs of the on, ft, yt, and 5,- were all determined in 
making £ a maximum, in general r\ and f will not also have their greatest numerical 
values. Necessary and sufficient conditions that £, rj, and f shall simultaneously 
have their maximum numerical values are that the ratios 

(b 2 c 3 — b 3 c 2 ) : (b 3 ci — &ic 3 ) : {bic 2 — b 2 c{), 
(a 2 c 3 — azd) : (a 3 ci — fflic 3 ) : («ic 2 — a 2 Ci), 
{a 2 b 3 — a 3 bi) : (a 3 h — aib 3 ) : (aib 2 — a 2 b{), 

shall have the same signs in the three lines. 

It is obviously improbable that in any physical problem the errors in the 
observations should all have the precise signs and numerical values to make £, 
t], or f a maximum numerically. There is a temptation to draw from this fact an 
erroneous conclusion, viz., that it is probable that £, rj, and f should be near their 
mean values, or zero. This would be true if they were determined by a series 
of measurements whose numerical extremes are given by (13) and the two corre- 
sponding equations. But the hypothesis is that the observations give no pre- 
sumption whatever as to the values of the a t , /3., and y t within the specified limits. 
This is actually the case in physical measurements. If many measurements are 
made the limits on the a,, ft, and y t are restricted, possibly, by taking their mean; 
but when they have once been determined any values within them are as improb- 
able as, and no more improbable than, any other values. Consequently, there is 
no presumption in any particular case that £ is near its mean value rather than 
near one of its extremes. In fact, equation (12) gives the true measure of un-. 
certainty in the determination of £. 

Equation (13) shows how the uncertainty in x depends upon the determinant 
D. Other things being equal the smaller D the greater the uncertainty in the 
solution. In the case of the numerical example considered above, equation (13) 
gives a total range in £ of twelve units in the third decimal. The results given 
in (3) differ by eight units in the third decimal, showing that even this large 
variation in the solution is not the greatest possible. The value of y is uncertain 
nearly to two units in the second decimal, and z to twelve units in the third 
decimal. 
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An interesting point is illustrated by the numerical example which has been 
under discussion. The solution of (1), regarding the digits beyond the fifth place 
as being unknown, is determinate only to two decimal places; yet the equations 
will not in general be exactly satisfied if x, y, and z are varied in the fifth decimal. 
Since any digits in the fifth place in the solution are permissible, 'the fact that a 
solution does not exactly satisfy the equations does not prove that it is not cor- 
rect so far as it is determinate; and the fact that it does exactly satisfy the equa- 
tions does not prove that it is correct beyond where it ceases to be determinate. 
In general, when the determinant of a linear system of equations is small, the test 
of accuracy of the solution by direct substitution loses much of its value. 

The determinant of the coefficients of a linear system of equations has a 
geometrical meaning which makes intuitionally clear the fact that when it is small 
the solution is poorly determined. For simplicity, consider the three equations 
(4). Each is the equation of a plane, and their common point of intersection is 
the solution of the system of equations. The direction cosines of the perpen- 
diculars to these planes are proportional to the coefficients of x, y, and 2. When 
the equations are multiplied by such factors that a t 2 + b? + c? — 1, the direc- 
tion cosines are a t , b t , and c t . Suppose this has been done and consider the three 
perpendiculars which pass through the origin. They intersect the unit sphere 
whose center is the origin in points whose coordinates are the a i} hi, c,- (i = 1, 2, 3). 
The determinant D is then, by solid geometry, six times the volume of the tetra- 
hedron whose four vertices are the origin and the three points a„ b t , c t . The 
volume of the tetrahedron is small if the three points are close together, or if they 
are nearly on the same great circle on the unit sphere. In the first cases the three 
planes are nearly parallel, when obviously small uncertainties in their precise 
positions correspond to large uncertainties in the point at which they intersect; 
and in the second case the line of intersection of any two of them is nearly 
parallel to the third, so that again their point of intersection is poorly determined. 

There remains finally the question whether the fact that the solution is deter- 
minate to a smaller number of places than the original coefficients are given may 
not make it possible to shorten the computation by arranging the formulas so 
that tables with a small number of places can be used without loss of accuracy. 
If the solution is made by successive elimination of the unknowns the tables 
must contain at least as many places as there are significant figures in the coeffi- 
cients, for significant figures are lost in the process by the addition of nearly equal 
quantities having opposite signs. But if the solution is made by determinants, 
the elements of one or more columns can be made small by simple linear combina- 
tions of the columns. Since the expansion of a determinant is made up of terms 
having a factor from each column, each term contains one or more small factors. 
In multiplying together several factors containing various numbers of significant 
figures, it is sufficient to use tables having one more place than appears in the 
smallest factor. Hence short tables can be used if one or more columns of the 
determinants have only small numbers. 

The determinant solution of (1) for x is 



HAVING SMALL DETEEMINANTS 



249 



x = 



.24561, .35381, .36518 
.62433, .90274, .91143 
.17145, .23642, .24375 



.34622, .35381, .36518 
.89318, .90274, .91143 
.22431, .23642, .24375 

If in the numerator determinant two thirds of the third column is subtracted from 
the first column, and if the second column is subtracted from the third, the value 
of the determinant is not altered. In the denominator let the middle column 
be subtracted from each of the others, and then the third column added to the 
first. The resulting expression for x is 

.00216, .35381, .01137 
.01671, .90274, .00869 
.00895, .23642, .00733 



x = 



+ .00378, .35381, .01137 
-.00087, .90274, .00869 
-.00478, .23642, .00733 

The computation can now be made with four-place tables containing all the 

numbers required on two pages. In computing x it is found in two or three 

minutes that to three figures its value is — 1.03, which is as far as it is determinate. 

The University of Chicago, 
May 19, 1913. 



THE ACCURACY OF INTERPOLATION IN A FIVE-PLACE TABLE 
OF LOGARITHMS OF SINES. 

By A. M. KENYON and G. JAMES, Purdue University. 

In a table which gives the logarithms of sines for each minute of angle, the 
logarithms of sines of angles to tenths of minutes are obtained by interpolation. 

The name Ordinary Interpolation will be used to denote the process based on 
the assumption: 

(1) As the angle increases from m! to (m + 1)' the increment of the logarithm 
of its sine varies as the increment of the angle; that is, 

log sin (m + n/10)' = log sin m! + (w/10)(log sin(m + 1)' — log sin m') 

(n = 1, 2, 3, • • • 9). 

The error introduced by ordinary interpolation arises from two sources: 

(a) The essential error, due to the assumption (1). 

(b) The tabular error, due to the fact that the tabulated values of log sin m! 
and of log sin(m + 1)' are in error. 



